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Bang-bang trajectories with a double switching time: 
sufficient strong local optimality conditions 

Laura Poggiolini Marco Spadini* 

Abstract 

This paper gives sufficient conditions for a class of bang-bang extremals with 
multiple switches to be locally optimal in the strong topology. The conditions are 
the natural generalizations of the ones considered in [SJ [TJ] and [TB]. We require 
both the strict bang-bang Legendre condition, and the second order conditions for the 
finite dimensional problem obtained by moving the switching times of the reference 
trajectory. 

1 Introduction 



We consider a Mayer problem, where the control functions are bounded and enter linearly 
\ in the dynamics. 



minimize C(£, u) := c (£(0)) + c/(f (T)) (1.1a) 

m 

subject to = /„(£(*)) + «./.(£(*)) (Lib) 

s=l 

m^N , f(T)€JV> (1.1c) 

« = . . . ,u m ) e L°°([0,T], [-1, l] m ). (l.ld) 



> 

ON , 

t^J- , Here T > is given, the state space is a n-dimensional manifold M, Nq and Nf are 
smooth sub-manifolds of M. The vector fields /o, /i, . . . , f m and the functions cq, Cf are 
C 2 on M, Nq and A^j, respectively. 

We aim at giving second order sufficient conditions for a reference bang-bang extremal 
couple (£, m) to 6e a local optimizer in the strong topology; the strong topology being 
the one induced by C([0, T],M) on the set of admissible trajectories, regardless of any 
distance of the associated controls. Therefore, optimality is with respect to neighboring 
trajectories, independently of the values of the associated controls. In particular, if the 
5_i ■ extremal is abnormal, we prove that £ is isolated among admissible trajectories. 



We recall that a control u (a trajectory £) is bang-bang if there is a finite number of 
switching times < t± < • • • < t r < T such that each component Uj of the reference 
control u is constantly either —1 or 1 on each interval (tfc, ife+i ) ■ A switching time t^ is 
called simple if only one control component changes value at tk, while it is called multiple 
if at least two control components change value. 
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Second order conditions for the optimality of a bang-bang extremal with simple switches 
only are given in [5j [TTJ [IJJ [16] and references therein, while in |18] the author gives suf- 
ficient conditions, in the case of the minimum time problem, for L 1 -local optimality - an 
intermediate condition between strong and local optimality - of a bang-bang extremal 
having both simple and multiple switches with the extra assumption that the Lie brackets 
of the switching vector fields is annihilated by the adjoint covector. 

All the above cited papers require regularity assumptions on the switches (see the 
subsequent Assumptions 12 , ll 12 , 2 1 and 12 , 3 1 which are the natural strengthening of necessary 
conditions) and the positivity of a suitable second variation. 

Here we consider the problem of strong local optimality in the case of a Mayer problem, 
when at most one double switch occurs, but there are finitely many simple ones and no 
commutativity assumptions on the involved vector fields. More precisely we extend the 
conditions in [5] [2J [16] by requiring the sufficient second order conditions for the finite 
dimensional sub-problems that are obtained by allowing the switching times to move. 
The addition of a double switch is not a trivial extension of the known single-switch 
cases. In fact, as explained in Section 2.2, any perturbation of the switching time (of a 
double switch) of the components of u generically creates two simple switches, that is it 
a bang arc is generated. On the contrary, the small perturbations of a single switch do 
not change the structure of the reference control. 

We believe that the techniques employed here could be extended to the more general 
case when there are more than one double switch. However, such an extension may not 
be straightforward as the technical and notational complexities grow quickly with the 
number of double switches. 

Preliminary results were given in |17| . where the authors exploit a study case and in 
|15] that deals with a Bolza problem in the so-called non-degenerate case. Also stability 
analysis under parameter perturbations for this kind of bang-bang extremals was studied 

We point out that, while in the case of simple switches the only variables are the 
switching times, each time a double switch occurs one has to consider the two possible 
combinations of the switching controls. The investigation of the invertibility of the 
involved Lipschitz continuous, piecewise C 1 operators has been done via some topological 
methods described in the Appendix, or via Clarke's implicit function theorem (see 
Thm 7.1.1.]) in some particular degenerate case. 

The paper is organized as follows: Section 2.1 introduces the notation and the regu- 
larity hypotheses that are assumed through the paper. In Section 2.2, where our main 
result Theorem 12.31 is stated, we introduce a finite dimensional subproblem of (jl.ip and 
its "second variations" (indeed this subproblem is C 1,1 but not C 2 so that the classical 
"second variation" is not well defined) . The essence of the paper will be to show that the 
sufficient conditions for the optimality of an extremum of this subproblem are actually 
sufficient also for the optimality of the reference pair (£, u) in problem (jl.ip . In Section 3 
we briefly describe the Hamiltonian methods the proof is based upon. Section 4 contains 
the maximized Halmiltonian of the control system and its flow. In Section 5, we write 
the "second variations" of the finite-dimensional subproblem and study their sign on ap- 
propriate spaces. Section 6 is the heart of the paper and constitutes its more original 
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contribution; here we prove that the the projection onto a neighborhood of the graph of 
£ in K X M of the maximized flow defined in Section 4 is invertible (which is necessary 
for our Hamiltonian methods to work). Section 7 contains the conclusion of the proof of 
Theorem 12.31 In the Appendix we treat from an abstract viewpoint the problem, raised 
in Section 6, of local invertibility of a piecewise C 1 function. 

2 The result 

The result is based on some regularity assumption on the vector fields associated to 
the problem and on a second order condition for a finite dimensional sub-problem. The 
regularity Assumptions 12.21 and 12.31 are natural, since we look for sufficient conditions. 
In fact Pontryagin Maximum Principle yields the necessity of the same inequalities but 
in weak form. 

2.1 Notation and regularity 

We assume we are given an admissible reference couple (£, it) satisfying Pontryagin Max- 
imum Principle (PMP) with adjoint covector A and that the reference control u is bang- 
bang with switching times t±, . . . , t r such that only two kinds of switchings appear: 

• ti is a simple switching time i.e. only one of the control components ui, . . . , u m 
switches at time tf, 

• ti is a double switching time i.e. exactly two of the control components u\, . . . , u m 
switch at time ti. 

We assume that there is just one double switching time, which we denote by f. Without 
loss of generality we may assume that the control components switching at time f are u\ 
and U2 and that they both switch from the value —1 to the value +1, i.e. 

lim u v = — 1 lim u u = 1 v =1,2. 

t— >f— t— S-T + 

In the interval (0, f), Jo simple switches occur (if no simple switch occurs in (0,f), then 
Jo = 0), and J\ simple switches occur in the interval (f , T) (if no simple switch occurs in 
(r,T), then J\ = 0). We denote the simple switching times occurring before the double 
one by Oqj, j = 1, . . . , Jo, and by 9\j, j = 1, . . . , J\ the simple switching times occurring 
afterwards. In order to simplify the notation, we also define #oo := 0, #o,Jo+i := ^10 := t, 
01 Ji+l '■= T, i.e. we have 

e 00 := < 01 < . . . < 9 OJo < f := #o,J +i := #10 < #11 < • • • < Ul < T := 

We shall use some basic tools and notation from differential geometry. For any sub- 
manifold N of M, and any x £ N, T X N and T*N denote the tangent space to N at x and 
the cotangent space to at x, respectively while T*N denotes the cotangent bundle. 
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#01 #OJo T ^lO 01Ji 

Figure 1: The sequence of switching times 



For any w G T*M and any &c G T X M, (w , fo) denotes the duality product between a 
form and a tangent vector. 

7r: T*M — > M denotes the canonical projection from the tangent bundle onto the base 
manifold M. In coordinates £ := (p,x): 

vr : £ = (p,x) G T*M \-> x G M. 

Throughout the paper, for any vector field f:x&M*-> f(x) G T X M, we shall denote 
the associated Hamiltonian obtained by lifting / to T*M by the corresponding capital 
letter, i.e. 

F : £ G T*M^ (£, f(n£)) G R, 

and F will denote the Hamiltonian vector field associated to F. In particular for any 
s = 0,1, ... ,m F s {£) := {£ , f s (jr£)) is the Hamiltonian associated to the drift (s = 0) 
and to the controlled vector fields of system f)l . lb[) . 

If /, g: x G M i— > f(x) G T X M, are differentiable vector fields, we denote their Lie 
bracket as [f,g]' 

[f,g](x):=Dg(x)f(x)-Df(x)g(x) 

The canonical symplectic two-form between two Hamiltonian vector fields 'f and ~(5 at 
a point £ is denoted as cr In coordinates £ := (jp,x): 

tr(f,^) {£) :=-( P Bg(x), f(x)) + ( P Bf(x),g(x)). 

For any m-tuple u = (u\, . . . , u m ) G M m let us denote the control-dependent Hamiltonian 

m 

h u :£e T*M ' Y (£ , f (ir£) + ^ u s f s (ir£)) G R. 

s=l 

Let /t and be the reference vector field and the reference Hamiltonian, respectively: 

m 

f t (x) := / (x) +J2u a (t)f a (x) , %) := %(*£)) = h m (£) 

s=l 

and let 

H(£) :=max{h u (£): u£ [-1, l] m } 

be the maximized Hamiltonian of the control system. Also, let xq : = £(0), x^ := £(f) 
and := £(T). 
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The reference flow, that is the flow associated to ft, is defined on the whole interval 
[0, T] at least in a neighborhood of Xq. We denote it as 

S : (t, x) i y St{x). 

Thus, in our situation PMP reads as follows: 

There exist po G {0, 1} and an absolutely continuous function A: [0,T] — > T*M such that 

( P0 ,A(0))^(0,0) (2.1) 
Tr\(t) = f (i) Vt G [0, T] 

A(i) = F t (A(t)) a.e.<€[0,T], 

A(0)|r £o iVo =Podc (x ), A(T)|t £/ jv> = ~Po dc/(%) (2.2) 
F t (A(f)) = H(X(t)) a.e. t G [0,T]. (2.3) 

We shall denote £ := A(0) and := A(T). 

Maximality condition (|2T3]) implies u s (t)F s (\(t)) = u s (t)(X(t) , / s (f(i))) > for any 
t G [0, T] and any s = 1, . . . , m. We assume the following regularity condition holds: 

Assumption 2.1 (Regularity). Let s G {1, . . . ,m}. If t is not a switching time for the 
control component u s , then 

u s (t)F s (\(t)) = u s (t)(X(t) , / s (e(i))> > 0. (2.4) 

In terms of the switching functions a s : t G [0,T] i— > F s o A(t) G M, s = l,...,m 
Assumption 12.11 means u s (t) = sgn(cr s (t)) whenever t is not a switching time of the 
reference control component u s . 

Notice that Assumption 12.11 implies that argmax{/i u (A(t)) : u G [—1,1]™} = u(t) for 
any t that is not a switching time. 

Let 

hj '■= ft\(0 i]y § i j+1 y j = 0, . . . , Jj, i = 0, 1, 

be the restrictions of /t to each of the time intervals where the reference control u is 
constant and let Kij{l) := {I, kij(irl)) be the associated Hamiltonian. Then, from 

maximality condition (|2.3p we get 



— (Kij - Kij^x) o \(t) 



> 



for any i = 0, 1, j = 1, . . . , Jj, i.e. if is the control component switching at time 

6ij and Aij G { — 2, 2} is its jump, then 



_d 

dt 



A-ijO- s (ij)(t) 



> 



We assume that the strong inequality holds at each simple switching time Oij: 
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Assumption 2.2 

d 



dt 



(Kij - Kij-!) o A(i) 



> 



* = 0, 1, j = 1, . . . , Ji 



(2.5) 



Assumption [272] is known as the Strong BANG-BANG Legendre CONDITION FOR 
SIMPLE SWITCHING TIMES. 

In geometric terms Assumption 12.21 means that at time t = 9ij the trajectory t \— > A(i) 
crosses transversally the hypersurface of T*M defined by Kij = Kj-i, i.e. by the zero 



level set of F, 



s(ij)- 




Figure 2: Behaviour at a simple switching time 

As already said, without any loss of generality we can assume that the double switching 
time involves the first two components, u\ and U2 of the reference control u and that 
they both switch from —1 to +1, so that 



Define the new vector fields 



fcio = ^oJo+2/i + 2/ 2 . 



K := k OJo + 2f u , u = l,2, 



with associated Hamiltonians K v (&) := {£ , k u (Tr£)). Then, from maximality condition 
(1231) we get 



d 
dt 



2a u (t) 



t=T- 



t=T + 



d_ 

dt 



2F u o \(t) 



—2F u o\(t) 
dt 



t=T- 



t=T+ 



d 

d7 



(K u - K OJo ) o \(t) 



> 0, 



t=T- 



- (K 10 - K v ) o \{t) 



dt 



u=l,2. 



>0, 



t=T+ 



We assume that the strict inequalities hold: 
Assumption 2.3. 



dt 



{K v - K OJo ) o A(t) 



> 0, 



t=T- 



d_ 

dt 



(K w - K v ) o \(t) 



> 0, u = l,2. 



(2.6) 



t=T + 
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Assumption 12.31 means that at time f the flow arrives the hypersurfaces F-y = and 
F2 = with transversal velocity i?oJo an d leaves with velocity i^io which is again 
transversal to both the hypersurfaces. We shall call Assumption I2.3l the STRONG BANG- 
BANG Legendre condition for double switching times. 




Figure 3: Behaviour at the double switching time 

Equivalently, conditions (|2,5p and (|2,6p can be expressed in terms of the Lie brackets 
of vector fields or in terms of the canonical symplectic structure <7 (•, •) on T*M: 

Proposition 2.1. A s sumption 1 2. 2\ is equivalent to 

<A(%) , [h^u kij) (£(%))> = * ($i,3-u ^ij) (A(%)) > (2.7) 

for any i = 0,1, j = 1, . . . , Jj. 
Assumption \2.3\ is equivalent to 

<A(f) , [fcojo, K] (x d )) = a (t OJo ,t u ) (A(f )) > 0, 

H ^ n ^ v=\,1. (2.8) 

(A(f) , %, fcio] (x d )) = a [R v , if 10 ) (A(f)) > 

In what follows we shall also need to reformulate Assumptions 12.21 and 12.31 in terms of 
the pull-backs along the reference flow of the vector fields kij and k u . Define 

gij(x) := Sr 1 kij o Ss,.(x), K(x) := S^k u o S? (x) 

and let Gij, H v be the associated Hamiltonians. We can restate Assumptions [2T2l and 
12.31 as follows: 

Proposition 2.2. A s sumption 1 2. 2\ is equivalent to 

(4 , [gy-i, fltf] (So)) = o- ^v) $0 > (2.9) 
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for any i = 0,1, j = l,...,Jj. 
Assumption \2.3l is equivalent to 



(to , [90J ,K] (x )) = a (^oJo^u) [to) > 0, 

A -* \ ~ v = \,2. (2.10) 

(4 , [V Sio] (x )> =<t[Hu, G 10 ) (4) > 

2.2 The finite dimensional sub-problem 

By allowing the switching times of the reference control function to move we can define a 
finite dimensional sub-problem of the given one. In doing so we must distinguish between 
the simple switching times and the double switching time. Moving a simple switching 
time 6ij to time 8ij := 9ij+5ij amounts to using the values u\ ^ 1 §A anc ^ ^1 (§ § +1 ) °^ 

the reference control in the time intervals and (6ij,9ij+ij, respectively. On 

the other hand, when we move the double switching time f we change the switching time 
of two different components of the reference control and we must allow for each of them to 
change its switching time independently of the other. This means that between the values 
of u\(a -\ and u\/~ a \ we introduce a value of the control which is not assumed by 
the reference one - at least in a neighborhood of f - and which may assume two different 
values according to which component switches first between the two available ones. Let 
t u := f + £„, v = 1,2. We move the switching time of the first control component u\ 
from t to n := f + £i, and the switching time of the second control component v,2 from 
t to t 2 := f + e 2 . 

Inspired by jS], let us introduce C 2 functions a: M — > R and j3: M — > K such that 
a|iV = Poco, da(x ) = £ and (3\ Nf = p Cf, d/3(%) = -if. 

Define 0;j := % + <% , j = 1, . . . , J i} % = 0, 1; 9 ,j +i ■= min{r w , v = 1, 2}, (9i := 
maxjr^, ^ = 1,2}, #oo := and 9i t j 1+ \ := T. We have a finite-dimensional sub-problem 
(FP) given by 



subject to £(t) 



minimize a(f (0)) + /3(£(T)) (FPa) 
'k 0j {Z(t)) t e (9 0j ,e od +i) j = 0, . . . , J , 

t€(e , Jo+1 ,e 10 ), (FPb) 

iG(^,M j = 0,...,Ji 

and f(0) G JV , C(T) G 2V/. (FPc) 

where O O = 0, 0i, Jl+1 = T (FPd) 

9, :i 9, :i ■ <%, i = 0,l, j = l,...,Ji, (FPe) 

^jo+i := f + min{ei, e 2 }, #10 := t + max{ei, e 2 } (FPf) 

aud [ V=l lf£l - £2 ' (FPg) 
\i/ = 2 ife 2 <ei. 

We shall denote the solution, evaluated at time t, of fjFPb|) emanating from a point 
x £ M at time 0, as St(x,S,e). Observe that St(x,0, 0) = St(x). 
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(ei < £2) {—L-r 

0Q1 

(£2 < ei) [— — |— 

001 

Figure 4: The different sequences of vector fields in the finite-dimensional sub-problem. 

Notice that the reference control is achieved along £\ = £2, that is the reference flow 
is attained by (FP) on a point of non-differentiability of the functions 

6> ,j 0+ i : = t + min{ei, e 2 }, #10 := t + max{ei, e 2 }. 

We are going to prove (see Remark 15.11 in Section [5]) that despite this lack of differentia- 
bility of the switching times 9qj , 9io, (FP) is C 1 (indeed C 1 ' ) at 6{j = E\ = £2 = 

We can thus consider, on the kernel of the first variation of (FP), its second variation, 
piece-wisely defined as the second variation of the restrictions of (FP) to the half-spaces 
{(5, e) : £\ < £2} and {(5, e): £ 2 < £\}. Because of the structure of (FP), this second 
variation is coercive if and only if both restrictions are positive-definite quadratic forms. 
In particular any of their convex combinations is positive-definite on the kernel of the 
first variation, i.e. Clarke's generalized Hessian at (x,5,e) = (a?o,0, 0) is positive-definite 
on that kernel, see Remark 15.21 in Section [5] 

In Section [5] we give explicit formulas both for the first and for the second variations. 
We shall ask for such second variations to be positive definite and prove the following 
theorem: 

Theorem 2.3. Let (£, u) be a bang-bang regular extremal (in the sense of Assumption 
\2.1\) for problem (jl.ip with associated covector A. Assume all the switching times of(£,u) 
but one are simple, while the only non-simple switching time is double. 

Assume the strong Legendre conditions, Assumptions and HHA hold. Assume also 
that the second variation of problem (FP) is positive definite on the kernel of the first 
variation. Then (£,u) is a strict strong local optimizer for problem (jl . 1|) . If the extremal 
is abnormal (po = 0), then £ is an isolated admissible trajectory. 

3 Hamiltonian methods 

The proof will be carried out by means of Hamiltonian methods, which allow us to reduce 
the problem to a finite dimensional one defined in a neighborhood of the final point of 
the reference trajectory. For a general introduction to such methods see e.g. j3j. We 
repeat here the argument for the sake of completeness. 

In Section [4] we prove that the maximized Hamiltonian of the control system, H, is well 
defined and Lipschitz continuous on the whole cotangent bundle T*M. Its Hamiltonian 
vector field rJ is piecewise smooth in a neighborhood of the range of A and its flow, which 
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we denote as 

H: {t,£) G [0,T] x T*M ^ H t (£) G T*M, 

is well denned in a neighborhood of [0,T] x {£q} and A is a trajectory of i?: — A(i) = 

di 

H(X(t)), i.e. A(t) = Wt(4). 

In Sections |5][6] we prove that there exist a C 2 function a such that a\ N = £>o c o> 
da(xo) = Iq and enjoying the following property: the map 

idxvr^: (t,£) £ [0,T] x Ai-> {t,-nU t {l)) G [0,T] x M 

is one-to-one onto a neighborhood of the graph of £, where A := {da(x) : x G 0(xo)}- 
Indeed the proof of this invertibility is the main core of the paper and its main novelty. 

Under the above conditions the one-form uj := T~L*(pdq — H dt) is exact on [0, T] x A, 
hence there exists a C 1 function 

X : (t,£) G [0,T]xA^ X( (f)eK 

such that dx = uj. Also it may be shown (see, e.g. [5]) that d{xt°{' K T~it)~ l ) = Ht° ( 7T 'Ht)~ 1 
for any t G [0, T]. Moreover we may assume xo = a ° 71 

Observe that = (id xirT-L)(t,£o) and let us show how this construction leads to 

the reduction. Define 

V := (id XttH)([0, T] x A), V := (id xvrft) -1 : V -»■ [0, T] x A 

and let (£,it) be an admissible pair (i.e. a pair satisfying (jl . fjl. lc|) — f)l . ld[) ) such that 
the graph of £ is in V. We can obtain a closed path T in V with a concatenation of the 
following paths: 

. S:iG [0,T]^(U(t))GV, 

• $t:s£ [0, 1] h-> (T, (Pt(s)) G V, where ^ T : s G [0,1] H> </?t(s) G M is such that 
^t(0) = £(T), <pr(i) = x f , 

• S: t G [0, T] i— > (i,£(i)) G V, ran backward in time, 

• $0: s G [0, 1] h-> (0, ^o(s)) G V, where ip : s G [0,1] H> ¥>o(s) G M is such that 
(A)(0) = x , ^o(l) =C(0). 

Since the one-form w is exact we get 



= <p uj = I uj + / uj — uj + UJ. 
From the definition of uj and the maximality properties of H we get 



oj = 0, / oj<0 (3.1) 
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^(tU(o)) 




M 

«U(0)) 



(0,x 



Figure 5: The closed path V and its preimage 



so that 



Since 



w + / uj > 0. 



(3.2) 



w = / d(xT°(vr^T) *) = XT ° (tt^t) - XT ° (vr^ r ) 1 (^(T)), 

lo = I (da(<p Q (s)) , (p (s))ds = a(f(Q)) - a(x Q ), 
V>(*o) Jo 



inequality (|3,2p yields 

a(£(0)) - a(x ) + XT o (t^t)" 1 ^/) - X t o (vr^r)- 1 ^^)) > 0. 

Thus 



(3.3) 



a(£(0))+/?(£(T))-a(x )-/3(%) > 

> (XT o (ttUt)- 1 + /3) (£(T)) - (xt o (t^t)" 1 + /3) (x f ) (3.4) 

that is: we only have to prove the local minimality at Xf of the function 

T: x e N f n i—)- (xt o (tt^t)- 1 + /3) (x) € M. 

where 0(xf) is a small enough neighborhood of Xf. 

In proving both the invertibility of id xirTi and the local minimality of Xf for J 7 we 
shall exploit the positivity of the second variations of problem (FP). See (TJ [2j [3] for a 
more general introduction to Hamiltonian methods. 
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4 The maximized flow 

We are now going to prove the properties of the maximized Hamiltonian H and of the 
flow - given by classical solutions - of the associated Hamiltonian vector field . Such 
flow will turn out to be Lipschitz continuous and piecewise-C 1 . In such construction we 
shall use only the regularity assumptions 12, 1112,211231 and not the positivity of the second 
variations of problems (FP). 
We shall proceed as follows: 

Step 1: we first consider the simple switches occurring before the double one. We shall 
explain the procedure in details for the first simple switch. The others are treated 
iterating such procedure [5]; 

Step 2: we decouple the double switch obtaining two simple switches that might coincide 
and that give rise to as many flows; 

Step 3: We consider the simple switches that occur after the double one. For each of the 
flows originating from the double switch we apply the same procedure of Step 1. 

Step 1: Regularity Assumption 12. II implies that locally around £q, the maximized Hamilto- 
nian is Kqq and that \(t), i.e. the flow of i^oo evaluated in £q, intersects the level 
set {i G T*M: K 01 (£) = K 00 (£)} at time 6 QX . Assumption O yields that such 
intersection is transverse. This suggests us to define the switching function 9q\(£) 
as the time when the flow of i?oo> emanating from £, intersects such level set and 
to switch to the flow of K$\ afterwards. To be more precise, we apply the implicit 
function theorem to the map 

$oi (M) := (Koi ~ K 00 ) o exptf 00 (£) 

in a neighborhood of (t,£) := (0 O i,4) in [0,T] x T*M, so that H(£) = K 00 (£) for 
any t E [0, 9qi(£)]. We then iterate this procedure and obtain the switching surfaces 
{(e 0j (£),£) : £ G 0(4)}, j = l,... t Jo where: 

0qo(£) := ^oo(^) := I 

and, for j = 1, . . . , Jq, we have 

— 0oj(£) is the unique solution to 

(K 0j - Koj-i) o expflo^fl^o.j-i (voj-iW) = 

defined by the implicit function theorem in a neighborhood of (t, £) 

— ifoj{£) is defined by 

(foj(£) ■= exp ( - 6 j(£)K j) o exp6» j(£)^o,j-i (<poj-i(t)) ■ 



— (0oj,£o); 
(4.1) 
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\ 1 



^00 ^01 



o e 01 (£) e m {£) ■■■ 

Figure 6: Construction of the maximized flow. 



Step 2: Let us now show how to decouple the double switching time in order to define the 
maximized Hamiltonian H(t) in a neighborhood of (f,A(f)). In this we depart 
from [5j in that we introduce the new vector fields k\, k 2 in the sequence of values 
assumed by the reference vector field. We do this in five stages: 

— for v = 1, 2 let t u (£) be the unique solution to 

2F U o expT v (t)ltoj (<poj (£)) = (K v - K OJo ) o ex P T u (£)t j ( V0 J (£)) = 

defined by the implicit function theorem in a neighborhood of (f,£o); 

— choose 

6 ,j 0+ i(£) ■-xmn{T 1 (£),r 2 (£)}; 

— for v = 1, 2, define 

<f%,j +iW : = ex P ( - T v(£)K v ) o ex.pT v (£)K OJo (<PoJo(fi) > 
and let 9\q{£) be the unique solution to 

2F 3 _„ o exp0 lo (*A Kj 0+ iW) = 

= (K 10 - K v ) o exp9 10 (£)f v (<f% t j 0+1 (l)) = 

defined by the implicit function theorem in a neighborhood of (f,£o); 

— for v = 1 , 2 define 

rt := exp ( - eUtrfio) o expfl^it Kj 0+ i(*)) \ 

— choose 



'10 



{£) 



?i„(*) if ri(£)< 72,(4 
% (i) ]£r 2 (£)<n(£). 



Notice that if n(£) = t 2 (£), then 0\ Q {1) = 0? o (i) = n{£) = t 2 (£) so that 1O (-) is 
continuous. To be more precise, the function #io( - ) is Lipschitz continuous on its 
domain and is actually C 1 on its domain but with the only possible exception of 
the set {£ G T*M: n{£) = t 2 (£)}. 

Step 3: Finally we define analogous quantities for the simple switching times that follow 
the double one. For each j = 1, . . . , J\ we proceed in three stages: 
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— for v = 1 , 2 let 0\ ■ (£) be the unique solution to 



defined by the implicit function theorem in a neighborhood of (^-,^o)j 
— define 



:= exp ( - 0^%) o exp^-^^u-i fe-rW) i 



— choose 




We conclude the procedure defining 0x^+1 (i) — 0\ J +1 {£) = (/) := T. 

To justify the previous procedure we have to show that we can actually apply the implicit 
function theorem to define the switching times and that they are ordered as follows: 



We prove it with an induction argument. The functions #oo(") an d ¥?oo(") are obviously 
well defined. Assume that Oqj, (fiQj are well defined for some j > 1 and let 



which is positive by Assumption 12. 2| so that the implicit function theorem yields the C 1 
function #oj'+i- Thus, we also get a C 1 function (fo.j+i by equation (|4.ip . By induction, 
the #o/ s are we h defined for any j = 1, . . . ,Jq and, by continuity, the order is preserved 
for £ in a neighborhood of £q. Also, the implicit function theorem yields a recursive 
formula for the linearizations of Oqj and <poj at £$: 



e 0J -i(£) < e 0j (£) ...< e OJo (£) < e , Jo+ i(£) < o w {i) <e u {i)<.... 




Then one can compute 



d$o,j+i 

at 



(fo,i+iA) 




(d0 Oj (£o), 5£) 



a (exp(9 jKo t j-. 1 )*(po t j-. 1 *(5£), (K 0j - Ao,j-i)(A(0oj)) 



(4.2) 
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Let us show that 0o,J o +i an d #10 are a l so wen defined. Let 

£) = (#„ - K Jo) exp t^oJo ^0J (0 f = 1, 2. 

Then 

^oJoA) (A(f)) 1/= 1,2 



at 



= (T 

("Mo) 



which are positive by Assumption 12,31 so that tj(-) and r 2 (-) are both well defined again 
by means of the implicit function theorem. 
Now let 

^o(M) = (K 10 - K v ) o exptf u o <p% iJa+1 (£), u = l,2 



then 



10 



Of 



a[t v ,t w )(X{f)), 1/ = 1,2 



which are positive again by Assumption 12, 3| and the same argument applies. 

As already mentioned, by assumption 0o,j-i < @0j an d 9oj < f so that, by continuity, 
9o,j-i{£) < Qoj{£) an d 9qj q {£) < ^o,J +i(^) = mm { T i(^)' r 2(^)} f° r an Y ^ m a sufficiently 
small neighborhood of £q. 

Let us now show that 9o t j +i(£) — ^io(^)- We examine all the possibilities for t\{£) 
and T2(£): 

• assume £ is such that 9q j j +i(£) = r i(^) < r 2(^)- Since ^2(72 CO > = one has 
* 2 (M) = ^(r 2 (^),£)(t-T 2 (£)) + (i-T 2 (^)) = 



_> +o(l)). 



In particular, choosing i = #o,Jo+i(^) = T i(^)i ^y Assumption 12,31 and by continuity, 
when £ is sufficiently close to £q, we have Y^(#o,j +i(^)) < 0, that is: 

* 2 (9o,j 0+ i(£),£) = (K 2 - K OJo ) o exp# ,Jo+i(^OJo WJ (£) < 0. (4.4) 
Since K 2 — Kqj = 2F 2 = K\q — Ki, equation (j4.4p can also be written as 

> (if 10 - Ki) o exp O^i o exp6 , o,j 0+ i(^)^oJ ¥>0J (^), 

i.e. the switch of the component u 2 has not yet occurred at time T\(£), so that 
e 1 lo (£)-T l (£)>0. 

Analogous proof holds if Oq j +i(£) = T 2(£) < T i(£)i 
If £ is such that n(£) = t 2 {£), then 9 W {£) = 9 ,j 0+ i(£). 
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For the simple switches occurring after the double one, by continuity, we have: 

< maxftw/yW} < mm{e{ j+1 (e),el j+1 (e)} < e w {i) 

for fin a sufficiently small neighborhood of £q. 

For the purpose of future reference we report here the expression for the differentials of 
the Ooj's, t u 's and fl^'s, and of the y?oj*' s V 7 *' 8 an d Vij*' 8 - Such formulas can be proved 
with an induction argument. 

Lemma 4.1. For any j = 1, . . . , Jq consider the following endomorphism of T~ (T*M): 

j 

o,s-i)(4)- (4.5) 

s=l 

Then 



-a (A ,j-i6£, Oj - ^ j_i)(4)) 
(d<%(* ) , = ^ S (4.6) 



-cr(A j ^,(f,-^oJo)(4))) 
(dr„(4) , <M> = ^ t=? =FV ^ ^, (4.8) 

*(a OJo S£ - (dr„(4) , 5£){t v - ^ J )(4) , 0io - i£„)$>)) 

and 

Vo,Jo+i* W = exp(-f^,),Hf, (a j <5£ - (dT„(4) , <«>(^ - ^oj )(4))- (4.10) 
Moreover 

^0 Jn i ^ 



(d^ (4) , <M> = (dn(£ ) , St) - <d(n - r 2 )(4) , 



OJo i 2 I V«0 



<d(9? (4) , = (dr 2 (4) , SI) - (d(r 2 - n)(£ ) , <W>- 



(^1,^10) (4) 
Goj ,i?i) (^o) 



(T 

a 



^10) $>) ' 

.A/so, /or i/ = 1, 2 and j = 0, . . . , Ji consider the endomorphisms 
A^S£ = A OJo S£ - (dr u (£ ) , - 3 j )(4)- 

- (d^ (? ) , o7)0 lo - %)(£o) - J2(d9Uto) , (3u - ($i,s-i) $>) 



(4.11) 



(4.12) 



s=l 
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Then 



(4.13) 
(4.14) 



and 



(4.15) 



Thus we get that the flow of the maximized Hamiltonian coincides with the flow of the 
Hamiltonian H: (t,£) G [0,T] x T*M ^ H t {l) G T*M: 



H: (t,£) G [0,T] x T*M ^ H(i) G T*M 



(4.16) 



H t {£) :-- 



k u (£) te(e ,j +i(£),e w ( 

[K 1:j (£) t£(6 l3 (£),0 1J+1 (£ 



j = 0,..., Jo 

9 0Jo+1 (£) = t v (£) 
j = 0,...,J 1 . 



5 The second variation 

To choose an appropriate horizontal Lagrangian manifold A we need to write the second 
variations of sub-problem (FP) and exploit their positivity. To write an invariant second 
variation, as introduced in [3], we write the pull-back Q(x,6,e) of the flows St along the 
reference flow St, which also permits us to analyze the influence of the double switch on 
the final point of trajectories. 

For the sake of greater clarity we first clear the field of all the notational difficulties by 
performing our analysis in the case when only the double switch occurs. Only afterwards 
we will discuss the general case. 

Let 5o,Jo+i := m i n { £ i) £ 2}) ^io := max{ei,£2}- At time t = T we have 

( T (x, 5, e) = S^ 1 o S T {x, 5, e) = exp (-£ 10 ) gio° 

o exp (5i - <5 i) K o exp (<$ i - 5oo) 9oj (x) 

where v = 1 if E\ < Si, v = 2 otherwise. Let f\ and f 2 be the pull-backs of f\ and f 2 
from time f to time t = 0, i.e., 

lv ■= Sfl f v o Sf , u = l,2 

so that 

K = 9oj + Vv, v = l,2, gio = goj + 2/i + 2/ 2 . 
The linearized flow at time T has the following form: 

L(5x,5,e) = 5x + (5 n - $oi)goi(x) + 2(5 n - £i)h{x) + 2(5 n -e 2 )f2{x), 
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which shows that the flow is C 1 . 

Let us now go back to the general case: at time t = T we have 

(t(x,5,e) = S^ 1 o S T (x,5,e) = exp {-5u 1 )gu 1 o . . . o exp (5u - 5 W ) gio° 
o exp (<5i - S ,j 0+ i) K o exp {6 ,j 0+ i - 6 OJo ) g j o ... o exp 5 01 g 00 (x) 

where v = 1 if E\ < 82, v = 2 otherwise. 
Define 



GOO 


:= Soi; 










'■= $0,j+l - $0j 


i 


= 1,. 


• 5 ^0 


b 


:= 610 — <5o,j +i; 












i 


= 0,. 




aiJi 


■= -*iJi- 









1 Ji 

Then 6 + a^- = and, with a slight abuse of notation, we may write 

1=0 jr=0 

( T (x, a, b) = exp au 1 gu 1 o ... o exp augu o exp a^io 
o exp o exp a j g j o ... o exp a i5oi exp a 00 g o(x), 

- where v = 1 if E\ < 82, v = 2 otherwise. Henceforward we will denote by a the 
(J + J\ + 2)-tuple (a o, • • • ,a j ,ai , . . . ,a\j^). 

The reference flow is the one associated to (a, b) = (0, 0). The first order approximation 
of (t at a point (x, 0, 0) is given by 

1 Ji 



L(Sx, a, b) = Sx + bh u {x) + aijgij(x) = 

Jo-l * =0j=0 
= fe + ^ a Oj g 0j (x) + (<Jo,Jo+i - <W o )#oj o 0e)+ 



J, 

+ (£10 - <5o,j +i)Mz) + (£11 - Sio)gi {x) + ^2 aijgij{x) 

3=1 

where v = 1 if E\ < 62, v = 2 otherwise. Introduce the pull-backs of fi and /2 from time 
f to time t = 0: 

fu-=STlf v oS f 1/ = 1,2. 
Then /i„ = cfoJo + 2/^ = 1,2, and 510 = 50 J + 2 /i + 2/2. Thus 
J0-1 

L(Sx,a,b) = Sx + ^2 a 0j9oj(x) + {S ,j 0+ i - S j )goj {x)+ 

J= ° „ * 
+ (£10 - S ,j +i){goj + 2 U)( X ) + (£11 - £10) (50 Jo + 2 /i + 2/2) («) + ^2aij9ij(x) = 

3=1 
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Jo-i 

= 5x + ^2 a 0j g j(x) + (S u - 5 j )g j (x) + 2(5 U - e 1 )/i(a;)+ 

" . * <"> 

+ 2(5n - e 2 )f2(x) + ^2a lj g lj (x). 

i=i 

Remark 5.1. Equation [5J] shows that in L(5x, a, b) we have the same first order expan- 
sion, whatever the sign of £2 — £\- This proves that the finite-dimensional problem (FP) 
is C 1 . 

Let f3 := (3 o St and 7 := a + /3. Then the cost (IFPaft can be written as 
J(x, a, b) = a(x) + (3 o St(x, a, b) = a(x) + f3 o Ct(^ 5 a, &) 
By PMP d7(xo) = 0, thus the first variation of J at (x, a, b) = (xo, 0, 0) is given by 

1 Ji 

J'(6x,a,b) = (bh u + Y<Yl ■ /3(*o) 

i=0 j=0 

which, by (|5.ip . does not depend on u, i.e. it does not depend on the sign of £2 — S\. 
On the other hand, the second order expansion of Q T (x,-,-) at (a, 6) = (0,0) is given 

by 



cxp 



(1 Ji ^ ( Jo Jo Jl 

i=o j=o I j=0 s=j+l j=0 

+ b\h v ,^a lj gi j \^+^a lj \g lj , ^ a ls g ls \ j (x). 



+ 



j=0 j=0 s=j+l 

where v = 1 if E\ < £2, v = 2 otherwise. Proceeding as in [5] we get for all (5x,a,b) G 
ker J', 

-. 1 Ji 

X[(5x,a,b)] 2 = -{d 2 7(x )[<5x] 2 + 2,5x- + ■ 0(z o )+ 

i=o 3=0 

1 Ji 2 Jo 3-1 

+ + bhu ) ' + X] X] a oi a Ojboi,5oj] • ^(z )+ 

i=0 j=0 j=0 i=0 

Jo Ji Jo 

i=0 3=0 i=0 

J'-l 

+ 5Z ai *[ fi,li ' 5 ' 1 j]) "^o)} 

i=0 

where, again, v = 1 if £1 < e 2 , v = 2 otherwise. 
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Remark 5.2. The previous formula clearly shows that Jf = J' 2 ' on {(5x,a,b): b = 0}, 
i.e. on {(Sx,5,e): E\ = £2}- The second variation is J" if e\ < £2, J'2 otherwise. Its 
coercivity means that both J" and J 2 are coercive quadratic forms. 

Remark 5.3. Isolating the addenda where aoj , b, a%o appear, as in ()5.1jl . one can easily 
see that J{' = J' 2 ' if and only if [fi, $2] ■ P(xq) = 0, i.e. if and only if (A(f) , [f±, f2](xd)} 
I). In other words: problem (FP) is twice differentiable at (x, 5, e) = (xq, 0, 0) if and only 
if (A(f), [/i,/ 2 ](x d )) = 0. 

The bilinear form associated to each J" is given by 

J'l ((Sx, a, b), (Sy, c, d)) = ~ j d 2 j(x )(5x, 5y)+ (5.2) 

Jo Jl 

+ Sy- ( ^2 a 0i 90i + bh u + '^2 a u 9ii) ' 

8=0 1=0 

+ &c • ( c 0i 5oi + dh„ + cij giij • /3(x )+ 

i=0 i=0 
Jo Ji Jo Ji 

+ ( Coi 9oi + dK + ^2 c u 9li) ■ ( a °* 9oi + bh v + ^2 au 9u ) ' ^(^o) + 
i=0 i=0 1=0 i=0 

Jo J— 1 Jo 

+ XI a 0ic 0j [ffoi , 5oj] • P@o) +d^2aoi[goi,K] ■ (3(x )+ 

j=0 i=0 1=0 

Ji Jo 3-1 ^ ~\ 

+ ^2 c ^{^2 a 0i[90i,gij] +d[h u ,g lj ] + ^aii[5li,Sij]J • /3(x ) > 
j=0 8=0 i=0 J 

By assumption, for each = 1, 2, J" is positive definite on 

M := {(5x,a,b) G x R J o+ J i+ 2 x R: 

1 Ji 

b + Y,J2 ai i = > L(6x,a,b) eT$ f N f y 

i=0 j=0 

Again following the procedure of [S] we may redefine a by adding a suitable second-order 
penalty at xq (see e.g. [9], Theorem 13.2) and we may assume that each second variation 
J'l is positive definite on 

j+Ji+2 x 



M := {(<5x, a, b) G T So M x M JoH 

6 + ^^ aii = 0, L(5x,a,b) GTj^iVyj, 



1 Ji 



i=0 j=0 

i.e. we can remove the constraint on the initial point of admissible trajectories. 
Let 

A : = {da(x): x G M} 
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and introduce the anti-symplectic isomorphism i as in [5], 

i: (dp, Sx) G T| o M x T ?0 M ^ -Sp + d(-(3)Jx G T (T*M) . (5.3) 

Define = r 1 ^" = i -1 (^u(£o)\ The Hamiltonian fields and 

are associated to the following linear Hamiltonians defined in T| M x T~„M 

G"j{u), Sx) = (w , gij(x )} + 5x • gij • f3(x Q ) (5.4) 
F"(a;, &e) = (u , h v {x Q )) + 5x-h u - (3(x ). (5.5) 

Moreover Lq := i _1 7> A = {&£ G T| o M x 7~ M: <5£ = (-L> 2 7(£ )(<^, •)) }■ With such 
notation, the bilinear form J'J associated to the second variation can be written in a 
rather compact form, see, e.g. [5j or [14] . 
For any 5e := (Sx, a,b) G M let 

wo := — D 2 j(xq)(5x, •), 5£ := (wo>&c) = (da*5x) , 

(uv, &Ej,) := <5£ + ^ ^ a ijG'lj + b n" v and 5^ := 
i=o j=0 

Then J" can be written as 



Jo Jl 



J"((5x,a,b),(5y,c,d)J =-(u u , 5y + ^c 0s c/os + dh v +^cx s g u 

s=0 s=0 
Jo 3-1 Jo 

+ J2^ G oj{ Si + Y, a ^os) +dHt(6£ + J2 a ^os) (5.6) 

j=0 s=0 s=0 

Ji Jo j-l 



j=0 s=0 s=0 

We shall study the positivity of J'J as follows: consider 

V := U8x,a,b) eM: L(8x,a,b) = o} 

and the sequence 

Vqi C . . . c V OJo c Fio c . . . c V Ul = V 
of sub-spaces of V, defined as folllows 

v 0j '■= {(Sx,a,b) £V: a 0s = Vs = j + 1, . . . , J , a ls = 0} 
Vy :={(<5x,a,6) G V: a ls = Vs = j + 1, . . . , Ji}. 

Observe that V^- = V^- for any j = 0, . . . , Jo, so we denote these sets as Voj. Moreover 



dim (v 0j n V Q Jl x ) = dim (v lk n V^A = 1, dim y 10 n v Q f; = 2 
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for any j = 2, . . . , Jq, k = 0, . . . , J\ and v = 1, 2 and J'J is positive definite on j\f if and 

only if it is positive definite on each Vij D V i Vio H ^jp" an d A/" Pi l/"*" 7 " . 

As in [5] one can prove a characterization, in terms of the maximized flow, of the 
intersections above. We state here such characterization without proofs which can be 
found in the aforementioned paper. 

Lemma 5.1. Let j = 1, . . . , Jq and be = (5x, a, b) £ Voj. Assume J'J is positive definite 
on Voj-i- Then be S V^j n V Q jZi if and only if 

s-l j-2 

G'L (St + 52 aor^l) = Gq'j-iC^ + 52 a oA) > V s = 0, . . . , j - 2 (5.7) 

r=0 s=0 

i. e. if and only if 

a 0s = (d(0 O|S+ i " 80s) (t ) , dajx) Vs = 0, . . . , j - 2. (5.8) 

/n f/izs case 



j- 1 _> 

J'l[5e] 2 = a oj (Gqj - Gqj_x) {81 + ^ a 0s O'L) 



s=0 

i-i 

= -a 0j cr(da*5x + ^ ao s G 0s (4), (G j - G 0) j-i)(4)V 

Lemma 5.2. Lei i/ = 1, 2 and 5e = (5x,a,b) G Pio- Assume J" is positive definite on 
Vb,j . T/ien <5e G Vio n I^ Jo " z/ and on/?/ i/ 

s-l J -l 

G&(« + £ ao M ^ M ) = GIj (5£ + 52 aos^'L) , Vs = 0, . . . , J„ - 1 (5.10) 

[i=0 s=0 
i. e. if and only if 

a s = (d(6 0yS+ i-6 0s )(£o),daJx) Vs = 0, . . . , J - 1. (5.11) 
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In this case 

J'l[5cf =b(K- Gq Jo ) (bl + ]T 00.3s.) 



s=0 

Jo 

+ aio (G'/o - (« + ^ a 0s G ' s + bfi'l) 

Jo 



= 6 <r (<« + £ a 0s G^, t" v - Jo ) + 

s=0 

Jo 

+ aio <r + £ a o^o s + Gi' - ti'l) = 

s=0 

Jo 

= - bcr(da*bx + ^ a 0s G 0s (? ), (^L - G ,j )(£o)j- 
s=0 
Jo 

- aio o~ (da*bx + ^ a 0s G 0s 



=0 

Lemma 5.3. Lei v = 1, 2, j = 1, . . . , J\ and be = (bx, a, b) £ Vy . Assume J" is positive 
definite on Vij-i. Then be G Vy D if and only if 

s-i Jo j-2 

Gl(bl + £ mG'^) = G'i^ibl + Y, mG'^ + bti'l + Y oiiGi'i) = 

i=0 i=0 i=0 

= i^(<W + £ aoi^o'J = G'[ k {5t + £ ao^'o'i + bl'l + £ a^'/J 

i=0 i=0 i=0 

Vs = 0,...,J Vk = 0,...,j-2 

«. e. z/ and on/j/ i/ 

a 0s = (d(6> 0)S +i - 6> 0s ) (4) , da*fe) Vs = 0, . . . , J 

6 = (d(6»i - ^o.Jo+i) (4) , da*5x) 
ai s = (d(0i )S+ i - 6»i s ) (? ) , da* (fa) Vs = 0, . . . , j - 2. 

In f/ws case 

Jo J-l 
J^[oe] 2 = ay (Gy- - G'lj^) (b£ + £ a 0s ^ s + ht" v + £ a^'L) 

s=0 i=0 

Jo . . i-i 



= ay <r (<W + £ a 0s G^ + + £ , 3y - t'i^ 

s=0 i=0 

Jo 

= -ay er(da:*<fa + y^a gGo s (?o) + bH v (i Q ) + y*aiiGii{£o), (Gy - Gi^-i)^)) ■ 



s=0 i=0 
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Lemma 5.4. Let v = 1,2 and be = (Sx,a,b) £ N. Assume J" is positive definite on 

j" 

V\j 1 . Then be £ N Pi V\j v if and only if 



S—l Jo Jl—l 



Gl(bl + Y J ^k) = Gl h (bl + Y j a Ql ^l + bt'l+Y J ai^i'J = 

i=0 i=0 i=0 

= H"(5£ + m^l) = G'! k (6£ + £ a 0l ^ + bt'l + Y J 



i j 

i=0 i=0 i=0 



Vs = 0,...,J Vfc = 0, Ji 

i. e. if and only if be £ M and 

a 0s = (d(0 OjS +i - 0s ) (£ ) , dajx) Vs = 0, . . . , J 

b = (d(6»i - #o,J +i) (4) , dajx) 
a ls = (d(0 1)S+ i - ls ) (4) , da*fe) Vs = 0, . . . , J\ - 1. 

In this case 

l Ji 



J"[be] 2 = -{uj u , bx + ^2^2a is g is (xo) + bh u (x )) = 

i Ji 

= cr^(0Jx + ^2^2a is g is (x ) + bh u (x )) , 

i=0 s=0 

1 J t 

- D 2 j(x )(bx, •) + E E + 

i=0 s=0 

1 Ji 

= -<x(d(-/3)*(<5x + ^^"i s fe(io) + bh u (x )) , 

i=0 s=0 



i=0 s=0 

6 The invertibility of the flow 

We are now going to prove that the map 

idxnH: (M) G [0, T] x A >->■ (t,7rH t (£)) € [0,7] x M 

is one-to-one onto a neighborhood of the graph of £. Since the time interval [0, T] is com- 
pact and by the properties of flows, it suffices to show that TrUn , i = 1, 2, j = 1, . . . , Jj 

and 7rWf are one-to-one onto a neighborhood of and £(f) in M, respectively. 

The proof of the invertibility at the simple switching times 9oj, j = 1, . . . , Jq my be 
carried out either as in [5] or by means of Clarke's inverse function theorem (see [7J Thm 
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7.1.1.]), while the invertibility at the double switching time and at the simple switching 
times Oij, j = 1, . . . , J\ will be proved by means of Clarke's inverse function theorem or 
by means of topological methods (see Theorem I7.6[) according to the dimension of the 
kernel of d(ri — t<i)\t~ a- 

For the sake of uniformity with the others switching times, for the simple switching 
times #oj> j = 1> • • • > Jo an d we give here the proof based on Clarke's inverse function 
theorem. Namely, we consider the expressions of t^H^ {£) , which are different according 

to whether 9oj(£) is greater than or smaller than Oqj. We write the linearization of such 
expressions and their convex combinations. Finally, using the coercivity of the second 
variation on Voj we prove that all their convex combinations are one-to-one. 

The flow 7~Lq o at time 9qj, associated to the maximized Hamiltonian defined in equation 
(|4.16p . has the following expression: 

%- (£) = / ex PS'-^°,j-l(yoj-l(^)) if 9 0j (l)>6 0j 

o exp 9 0j 

Lemma 6.1. Let j G {1, . . . , Jo}. Define 

A j: 51 G T~ A i y 7r* eyLp§oj~lo,j-i*(po,j-i*5£ G T-^M 

B 0j : S£ G TjK ^ A 0J S£ - <d0 o #o) , S£) {k 0j - fc j-i) \ m>j) 6 T^M 

Then, for any t G [0, 1], the map 

tA oj + (l-t)B 0j :T t A^T mQj) M 

is one-to-one. 

Proof. Let t G [0, 1] and let 81 G T~ A such that (tA Qj + (1 - t)B 0j )(5£) = 0. We need to 
show that 5£ is null. From formula f j4 . 3 [) it follows that 5£ is in kei(tAQj + (1 — i)-Boj) if 
and only if 



Let <5x := n*5£, so that <5^ = da*5x. Equation (|6.ip is equivalent to 
Sx + ^(d(0 OiS+ i - 9 0s )(£ ) , <5£><? 0s (£o)+ 

s=l 

+ [t(d9 0j (£ ) , M) - (d0 OJ -i(4) , <y€))goj_i(x ) - i(dS'^o) , «>flty(£o) = 0. (6.2) 
Let 5e := (&c, a, b) such that 

a 0s = (d(0 Q)S+ i - O .)(4) , « = 0, . . . , j - 2 
aoj-i = *<dfl j(4) , «> - (d0 O j-i(4) , 
a 0i = -t(d0(y(A>), *0 

ao s = b = ai r = s = j + 1, . . . , Jq, r = 0, . . . , J%. 
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There are three possible cases: 

a) If t = 0, then 5e £ Voj-i D j-i = {0}, because of the coercivity of J". 

b) If t = 1, then 5e G Voj fl ^ J " = {0}, because of the coercivity of J'J. In both cases 
we thus have 5x = 0, so that 5£ = da*5x is also null. 

c) If t G (0, 1), then <5e E Vbj PI V Q Jl v Therefore, applying (J5l9|) we get 

< J^«5e] 2 = i(d%(4) , o"(W + ^(d^+i - 0os)(£o) , M> G 0s (4)+ 

s=0 

+ (t(de 0j (£ ) , «) - (d0 O) ,-i(4) , ^))^ 0) ,-i(4) , - #oj-i)$>)) = 
= f (d9 0j (e ) , 5£) <r(A 0ji -i^ + t (de 0j (io) , «>3 j-i(4) , Oj ~ 3 j-i)(4)) = 
= _ t (i _ t)(d0 Oi (4>) , S£) 2 a poj-i, ^Oi) (4), 
a contradiction. □ 

Lemma 16.11 implies that Clarke's Generalized Jacobian of the map nHg at £q is of 
maximal rank. Therefore, by Clarke's inverse function theorem (see Thm 7.1.1.]) the 
map tvHq is locally invertible about £q with Lipschitz continuous inverse. Hence the 
map 

ij> : (t, i) £[0,r]xA4 (t, irtit(£)) G [0, T] x M (6.3) 
is locally invertible about [0, f — e] x {^o}- m fact, ^ is locally one-to-one if and only if 
irUt is locally one-to-one in £q for any t. On the other hand nTit is locally one-to-one for 
any t < f if and only if it is one-to-one at any #oj • 

We now show that such procedure can be carried out also on [f — e,T] x {£o}, so that 
ifj will turn out to be locally invertible from a neighborhood [0, T] x O C [0, T] x A of 
[0, T] x {^o} onto a neighborhood U C [0, T] X M of the graph S of £. The first step will 
be proving the invertibility of irHf at ^o- 

In a neighborhood of 7r%f has the following piecewise representation: 

1. if min{Ti(f), t 2 {£)} > r, then nHf{£) = expfK j o cp j (£), 

2. if min{ri(£),r 2 (£)} = n(£) < f < 1O (£), then 

■K%r{£) = exp(f - n(^))Ai o expri(f)^oJo ° V^OJoW, 

3. if mm{T 1 (£),r 2 (£)} = r 2 (£) <f< 6 W (£), then 

■K%r{£) = exp(f - t 2 {£))K 2 o expT 2 (^)A J ° VoJoW, 

4. if min{ri(^),T 2 (^)} = n(f) < 9 10 (£) < f, then 

7rHr(£) = exp(f^io) o VioW = exp(f - 8 10 (£))K 10 o 

o exp(B w (£) - Ti(£))Kx o expri(^)^ J ° <A)J (^)> 
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5. if mm{n(£),T 2 (£)} = t 2 {£) < 9 10 (£) < f, then 

= exp(f^io) o rjj 10 (£) = exp(f - 8 10 (£))K 10 o 

o exp(6>i (^) - t 2 (£))K 2 ° expr 2 (£)K j o ^ J (^)- 

The invertibility of nTif will be proved by means of two different arguments: in the 
generic case when d(ri — t 2 ){£$): TV A — )■ R is not identically zero, we will use the 
topological argument of Theorem 17. 61 in the Appendix; whereas, in the opposite case we 
will apply Clarke's inverse function theorem [7J Thm 7.1.1.], as in the case of simple 
switches. In particular, in the special case when dn(£o)|T- A = dr 2 (£o)|T~ a = we will 

prove that nJif is indeed differentiable at £q. 




(a) t = Oj (b) t = t 



Figure 7: Local behaviour of Ht near £o a t a simple switching time and at the double 
one. 

In all cases we need to write the piecewise linearized map (irHf)*. 

1. Let M° = {6£ G TgA: min{(dri(? ) , (dr 2 (4) , <5£)} > 0}. Then 

(irH f )*6£ = L°6£:= {exptk OJo )*iT*<poj J£ V6£ G M° (6.4a) 

2. Let M 11 := G T^A: (dn(4) , < < (d0j o (4) , «), (dn(4>), «) < 
(dr 2 (4), Then 

(tt'Ht)*6£ = L u 5£ := -2(dri(4) , 6t)fi(x?) + exp(fk j )*Tr*(poj *5£ 

V5£ G M 11 (6.4b) 

3. Let M 21 := G 7-A: (dr 2 (4) , ^) < < (d0 2 o (? o ) , «), (dr 2 (£ ) , < 
(dri(? ) , Then 

(ttT^M = L 21 <« := -2(dr 2 (4) , S£)f 2 (x^) + exp(f fc j )*7r^oJo*^ 

V5£ G M 21 (6.4c) 
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4. Let M 12 := {5£ G TgA: (dn(4), <^> < (d^ Q (4) , < 0, (dn(4), S£) < 
(dr 2 (4), Then 

(ttW,)^ = L 12 5£ := -2(d^ (F ) , 6£)f 2 (xr)- 

- 2(dn(4) , 5t)h(x+) + exp(ffco Jo ).7r.^j ,« V5£ G M 12 (6.4d) 

5. Let M 22 := {51 G T ?q A: (dr 2 (? ) , S£) < {d6 2 w (£ ) , 51) < 0, (dr 2 (4) , < 
(dri(4), <^)}- Then 

(TrWf)*^ = L 22 ^ := -2(d0 2 o (4) , S£)fx(x f )- 

- 2{dT 2 (i ) , «)/ 2 (xf ) + exp(rk j )^<p j J£ V51 G M 22 (6.4e) 

Lemma 6.2. TTie piecewise linearized maps (|6 .4[) Ziaue the same orientation in the fol- 
lowing sense: given any basis o/T^Aq and any basis ofT^.M, the determinants of the 

matrices associated to the linear maps L°, L VJ , v,j = 1,2, in such bases, have the same 
sign. 

Proof. The proof is given by means of Lemma [7. 11 We show that for any 5£x, 5l 2 G Tg A 
and v = 1, 2 the following claims hold: 

Claim 1. If (dT v (£ ) , 51) < < (dT„(4) , Six) then L°(<^i) ^ Lf{5l 2 ), i.e. 

exp(f A; j )*7r*v?oj *(^i) / exp(ffcoj )*7r*^oJo *(<%) - (dr^Fo) , 8£ 2 ){k v - k j )(x?). 
Claim 2. If (d0^(4) , <%) < < (d0&(4) , Sh) then L^(^i) ^ L u2 {5£ 2 ), i.e. 

exp(f A;oj„)*7r*yoj *(^i) ~ (dr v (£ ) , 6£x)(k u - k j )(x f ) / 

/ exp(f/coJo)*vr*^OJo*(^2) - (dT„(4) , 5£ 2 )(k u - fcoJo )($>)- 

-(d^ (4), «2>(*10-M(^) 

Proof of Claim 1. Fix i/ G {1,2} and assume, by contradiction, that there exist 5£\, 
5£ 2 G 2~ A such that (dT„(F ) , <%) < < (dT„(4) , ^i) and 

exp(Tfcoj )*7r*<poj *(<^i) = 

= exp(fA;oj )*7r*^oJo*(%) - (dr^fo) , Si 2 ){k v - k OJo )(x+). (6.5) 

Let foj := Tr*5£i, i = 1,2. Taking the pull-back along the reference flow SV* an d using 
formula (|4.7|) . equation (|6.5p can be equivalently written as 

Jo-l 

fei - &c 2 + (d (0 O( a+i - 00s) (4)) , <^i - ^ 2 )5os(xo)+ 

+ (-(dr„$>) , <%> - (d0 O j o (A)) , - 5£ 2 )) 9oj (x ) + (dr„$j , M 2 }M*b) = 0- 
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That is, if we define 5x := 5x\ — 6x2, 

f (d(0 O)8 +i 54-54) s = 0, . . . , J - 1 

° 0s ' \-(d0 O j o (4) , <*4 - <%) - (d7y,(? ) , 54) s = Jo 

b := (dTv(£o , 54), and ay := for any j = 0, . . . , J\, then 5e := (5cc, a, 6) G V10 H V A j Q , 
so that by ([5T21) 

- (dr„(4) , 54)o-(da*5x + ( d (°o,s+i - Os )(4) , daJx)O 0s (£ ) 

s=0 

+ ((d0 O j o (4) , da*fe} - (dr„(4) , daJx 2 )~3oJ (£o) , " ^oj )(4)) > 
or, equivalently, 

- (dT„(4) , 54)er(A j da*5x - (dr„(4) , da*fe 2 )G j (4) , 

(f,-^ Jo)(4)) >0. 

Applying formula (j4.8p we finally get 

(dr„$)) , 54)^(4) , (3 j , (4) > 0, 

a contradiction. 

Proof of Claim 2. Let us fix v E {1, 2} and assume, by contradiction, that there exist 
54, 5£i G T~ A such that (d0£ o (4) , 54) < < (d0^(4) , Six) and 

exp(ffc Q jJ*7r*<poJo*(<^i) - (dr^^o) , S£x){K - k OJo )(xf) = 

= exp(Tkoj )*n*(p Jo*{S£2) - (dT u (£ ) , 5£ 2 ){K - k OJo )(xr)- 

- <d^ (4) , 54)(&io " k v )(x f ) (6.6) 

Let <5xj := ir*6£i, i = 1,2. Taking the pull-back along the reference flow and using 
formula (|4.7p . equation (|6.6p can be equivalently written as 

J0-1 

Jxi - Sx 2 + ^J(d(0 o , s+ i - 0os) (4) , 54 - 54)sos(zo)+ 

+ (d(r„ - 0qj o )(4) , S£x - 5£ 2 }g j (xa)+ 
+ (-(dr,(?o) , S£x - S£ 2 ) - (d0£ o (4) , 54)) /n(x ) + (d^ (4) , 54)<7io(*o) = 0. 

That is, if we define 5x := 5xx — 6x2, 




(d(0 OlS+1 - Os )(4) , S£x - 54) a = 0, . . . , Jo - 1 
(d(r i/ -0 OJo )(4), 54-54) s = J 
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b := -(dr„(4) , S£i - 8£ 2 ) - (d^ (4) , S£ 2 ), and 



(d^ (4) , 5 = 
s = 1, . . . , Ji, 



Ola := 

then <5e := (<5x, a, b) E Vio H V^j so that by Lemma 15.21 

(dr„(4)) , da*<5x) + <d^ (?o) , %)) <x(da*fe+ 
Jo-l 

+ J] (d(0 O) <+i - 0o.)$>) , daJx)G 0s (£ Q )+ 

s=0 

+ (d(r„ - 9 OJo )(£ Q ) , daJx)t OJo (£ Q ) , (t v - G* OJo )(£ ] 

Jo-l 

- (d^o(4) , 8e 2 )<r[da*6x + ^ (d(0 o , a +i - , da*<5x)G 0a (4)+ 

s=0 

+ (d(<r„ - ff J )ft) , daJx0 OJo (£ o ) - ((dr,(4) , da*fe) + (d^ (4) , 5£ 2 ))t v (£ Q ) , 

0io >0 

or, equivalently, 

((dr v (? ) , dajx) + (d^ (? ) , <%}) 0-(a O j o da*fe + (dr„(?o) , da*fo) (f J (4) , 

0Jo)(A))) - (d6*io(4) , <%}o"(Aoj da*&c+ 
+ (dT v (£ ) , da* o) - ((dr u (£o) , da*£x) 

%»i£,$>), 0io-^)(4)) >0 

that is 

\dr v (£o) , dajx) + (d0? o (4)) , %)J [ ~ (dr u (£ ) , da*5x> + (dr u (e ) , da*fe) 

£T(^0Jo: ^)$>)- 

- (d^o(4) , <%>(- (d^ (4) , da*fe) - (d^o(4) , %))o"(^ , ^lo)(4) > 0. (6.7) 

Since dajx = 8£ x - 5£ 2 , we get (d^ (? ) , (d0?o$>) , 5£ x )a(i v , <^i )(4) > 0, a 
contradiction. □ 

We can now complete the proof of the local invertibility of TrUf. Let us first consider 
the generic case when d(r\ — t 2 )(£q) is not identically zero on T^A. 

We need to express the boundaries between the adjacent sectors M , M" 3 . 

• The boundary between M° and M 11 is given by 

{5£ G T f A: = (dn(? ) , S£) < (dr 2 (£ ) , 6£)}; 
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• The boundary between M° and M 21 is given by 

{St G 2~A: = (dr 2 (F ) , St) < (drift) , <M»; 

• The boundary between M 11 and M 12 is given by 

{61 g t Iq A: (d^ft) , 8£) = 0, (drift) , < <dr 2 ft) , «)}; 

• The boundary between M 21 and M 22 is given by 

{8£ G T ?o A: (d0 2 o ft) , = 0, (dr 2 ft) , M> < (drift) , 

• The boundary between M 12 and M 22 is given by 

{81 G 2~A: (dr 2 ft) , M) = (drift) , St) < 0}; 

According to Theorem 17. 6| in order to prove the invertibility of our map it is sufficient 
to prove that both the map and its linearization are continuous in a neighborhood of £q 
and of respectively, that they maintain the orientation and that there exists a point 5y 
whose preimage is a singleton that belongs to at most two of the above defined sectors. 

Notice that the continuity of tvH? follows from the very definition of the maximized 
flow. Discontinuities of (7rHf)* may occur only at the boundaries described above. A 
direct computation in formulas (|6.4p shows that this is not the case. Let us now prove 
the last assertion. 

For "symmetry" reasons it is convenient to look for 5y among those which belong to 
the image of the set {51 G T~A : < (dri(4), S£) = (dr 2 (? ) , Observe that 

(dri(? ), 81) = (dr 2 (4), St) also implies (d^ (£ ) , St) = <dr v (? ) , St), v = 1,2, see 
formulas (|4.1ip . 

Let M G T ?q A such that < (dn(4) , Si) = (dr 2 (4) , ~5l) and let Sy := L°~8l. 
Clearly 8y has at most one preimage per each of the above polyhedral cones. Let us 
prove that actually its preimage is the singleton {8t}. 

In fact we show that for u, j = 1, 2, there is no 81 G M v i such that L u i{8£) = Sy. 

1. Fix v G {1,2} and assume, by contradiction, that there exists 8t G M lu such that 
L vl 8t = Sy. The contradiction is shown exactly as in the proof of Claim 1 in Lemma [6.21 

2. Fix v G {1,2} and assume, by contradiction, that there exists 81 G M u2 such 
that L u2 8t = 8y that is: let 8x := tt*8£, and 5x := ir*8t. Taking the pull-back along the 
reference flow at time r, and recalling formula (|4.7p we assume by contradiction that 

Jo Jo 
8x - ^(d0 Os (4) , 8£)(g 0s - g 0>s -i)(xo) = 8x - ^(d0 Os (4) , St)(g 0>s - 5o,a-i)(a?o)- 

s=l s=l 

- (drift) , S£)(K - g j )(x ) - (d^o(4) , 8£)(g 10 - K)(x ). 
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or, equivalently, 

Jo-i __ 

" 6x + Yl < d (^+i " e o,)(?o) , Si - S£))g Qs (x Q )- 

s=l 

- ((de OJo ft) , S?- <^> + (dri(4) , «>)$bJ (£o)- 

- (d(^ - r„)(4>) , «)/ii(x ) + (d^i (4) , «)fft (sco) = 0. 

Let be := (<5x — fe, a, 6), where, 

f<d(0 Q)S+ i-0 Os )(? o ), 3Z-<^) s = 0,...,J -l, 

\ (de OJo (£ ) ,S£-S£)- (drift) , s = J , 

6:=-(d(^o-T,)(£o), M>, 

f(d^ (4),^) s = 0, 
|ai s = s = l,...,J x . 



Then <5e G Pio H Vqj " an d Lemma 15.21 applies: 

< J'l[5e} 2 = -b*(Te-5l + J2 ac^o-ft), A - #oj )(4>)J - 

-aiocr ^-^ + ^a 0s ^ 0s (4) + A(4),0lQ-^i)(A))J = 
=(d(^ " t v )(? ) , <^> ((dT u (e ) ,S£-S£)- (dr u (i ) , S£)) a (t OJo ,t 



- (MMto) ,«>((- <d^ (4) ,M-S£)- (d0?o$>) , ^})<r (f „, ^ 10 ) $,)+ 



=<d(^ - T V ){£ ) , M)(dr„(4) , ^}<r (p 0Jo ,lf v ) (io) 
- (d^ (4) , ^)((d^ (4) , ^}<x (i^, ^ 10 ) (£o)+ 
+ (dr v (£ ), 5£)<r (~d Jo,^3-v 



which is a contradiction, since all the addenda are negative. 

By Theorem 17. 61 this proves the invertibility of irTi?, hence ip is one-to-one in a neigh- 
borhood of [0, 0io — e] x \£o}- 

Assume now that the non generic case T~ A C ker d(ri — T2)(£q) holds. We are going to 
prove the Lipschitz invertibility of irH? | a by means of Clarke's inverse functions theorem, 
see [7]. The generalized Jacobian &{ , k'Ht){£q) (in the sense of Clarke) of irTi?: A — > M 
at £q is the closed convex hull of the linear maps L°, L u i , u, j = 1,2 defined in (|6.4p . 
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We distinguish between two sub-cases: 

1. (drift) , 5£) = (dr 2 ft) ,S£)=0 for any 5£ G T ?q A 

In this case we also have d#{ (£o)|T~ A = d# 2 (£o)|T~ A = 0, see formulas (|4,lip . hence 

all the linear maps L°, L" J ', = 1,2 defined in (|6.4p coincide with the map L°, so 
that nHf is differentiable at £q. The invertibility of L° and Clarke's invertibility theorem 
yield the claim. 

2. (drift) , «) = <dr 2 ft) , for any 5t G 7- A but ker(dnft)|T ?( A) / T^A. In 
this case we also have d#{ (£o)|T~ A = d# 2 (£o)|T~ a = drift)|r~ A ( see formulas (j4.1ip ) 

ep £q cq 

so that L 12 = L 22 . 

Let {vi,v 2 , • • • ,v n } be a basis of Tj M such that (dri(^o) > da*t>i) = 1 and (dri(^o) j da*t>j) = 
for % = 2, ... We will show that d(irl-Lt)(£o) is made up of invertible matrices by 
showing that 

(L )- 1 (t L° + hL 11 + t 2 L 21 + t 3 L 12 + t 4 ^ 22 ) o da* 

is invertible for any to, . . . , t± > such that Ylt=o = 
Let i/ = 1, 2, i = 1, . . . ,n such that 

re 

-5oj )(^o) = J^e^. 

i=l 

We have 

(L ) -1 !^- 7 da*fj = f j i = 2, . . . , n and u, j = 1, 2 
and, for each 1/ = 1, 2: 

re 

(L°) _1 L iyl da*^i =vi- (h u - goj )(x ) = (1 - c^i - ^c^fc 

k=2 

(L )' 1 ^ 2 da*ui = vi - - 5oj )(2o) - (sio - M(^o) = 

re 

= (1 - c\ - c\)vi - + c|)f; fc . 

fc=2 

Thus the determinant of (L ) -1 (t L° + tiL 11 + t 2 L 21 + *3^ 12 + k^ 22 ) ° da* is given by 
to+h det(L°)" 1 L 11 da* + t 2 det^ )" 1 L 21 da* + (t 3 + i 4 ) det^ )- 1 ^ 12 da* which cannot 
be null since all the addenda are positive as it follows from Lemmata 16.21 and 17.11 This 
concludes the proof of the invertibility of Let us now turn to trUn , j = 1, . . . , J\. 

For any j = l,...,Ji, there are four regions in A, characterized by the following 
properties 

{£ G A: 6^(1) > fly and 9q,j 0+1 (£) = n(£)}, 
{I G A: 6^(1) > y and 9 ,j 0+ i(£) = t 2 {£)}, 
{£ G A: 6^(1) < § Xj and 9 ,j 0+1 (£) = n(£)}, 
{£ G A: y (*) < hi and 9 , Jo+1 (£) = t 2 {£)}. 
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As for nTif, t^H* turns out to be a Lipschitz continuous, piecewise C application. 
Its invertibility can be proved applying again Theorem 17.61 Let us write the piecewise 
linearized map (irH^ ,)* 

• Let N$ := {51 G T~ A: (drift)) , Si) < (dr 2 ft) , SI), (dfl^ft) , SI) > 0}. Then 

(nHg )*S£ = Aljdi := exp^fcij-i*)^*^!^!*^) 

. Let JVg» := {5i G TgA: (dr 2 ft) , < (drift) , 51), (d^-ft) , > 0}. Then 

)*S£ = A\ j 5£ := esqp^ijfeij-i*)^*^.!*^) 

• Let JV" := {<5£ G T^A: (drift) , < (dr 2 ft ) , (d^-ft , «) < 0}. Then 

(TrTig )J£ = B\ j 5£ := exp(6»ijfcij_i*)7r*^ij_ 1 *((5^)- 

-(d^-ft), S£)(hj - h,j-i)(xij) 

. Let iY^ 1 := {5£ G TgA: (dr 2 ft) , S£) < (drift) , M>, (d^-ft) , < 0}. Then 

-(d^-ft), S£)(hj - h,j-i)(xij) 

Analogously to what we did at time r, let us first consider the non degenerate case 
(d(ri — r 2 )(^o) j S£) ^ for some 5£ G T-£ A: according to Theorem 17.61 we only have to 
prove that both the map and its piecewise linearization are continuous in a neighborhood 
of £q and of respectively, that the linearized pieces are orientation preserving and that 
there exists a point 5y whose preimage is a singleton. 

The only nontrivial part is the last statement which can be proved by picking 5y G 
AljiNtf) n AljiN^): let M G J~A such that (drift) , Si) = (dr 2 ft) , Si) > and let 
~&y~ := A\jS£ = A\f£. 

Let v G {1,2} and assume, by contradiction, that there exists Sl v G N^j such that 
B^Slx = 3y, i.e. 

exp^ijfcij-i*)^*^^!^^) = 

= exptfijkij-iJirtipij^^Sl) - (d9ij(£ ) , S£)(kij - kij-i)(xij). 

Taking the pull-back along the reference flow Sg and defining Sx := iv*5i, 5x u := Tr*S£ v 
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we can equivalently write 



Jo 



Sx - Sx - y^(d6> 0s (4) , 5£ - 5£)(g 0s - go, 8 -i)(xo)- 



8=1 



- (d7v(4) , « - S£)(h v - 9oJo)(x ) - (d^ (4) , <tf - «>(<?io - K)(x )- 
^(d^ s (4) , St - S£)( 9ls - gx, s -i)(x ) - (d^(? ) , ?o)0»i - <?i,;-i)(£o) = 



8=1 



that is 



Jo-i 



<fc - <5a? + ( d ( 9 o,s+i - M4) , Si - Si)g 0s (x )+ 



8=0 



+ (d(T„ - O J O )(4) , « - ^)5oj (xo)+ 

3-2 

■ <d(0? o - r„)$>) , St - S£)h u (x ) + £<d(0? iS+1 - 0i.)(4>) , <tf - S£)g ls (x )+ 



8 = 

+ ((d^(4) , Si) - (de^ito) , Ti - 5£)) g hj -i(x ) - (d^.(? ) , S£) gij (x ) = 
Let 5e := (Sx — Sx, a, b), where, 

_ Ud(9 0:S+1 -9 0s )(£ ),6l-5£} s = 0,...,J -l, 
a ° s ' \(d(T„-e j )(£ ),S£-St) s = J , 

b:= (d(9 v lQ -T v ){£ Q ),M-S£) 

'(d(ei s+1 -eU£o),sl-S£) _ s = o,...,j-2 

{d90 o ), 5£) - (d^_i(4) , S£-6 



au ■= < 



-{6.6 



Wo) 



s = j-l, 

s = j, 

S=j + l,...,J 1 . 



Then 5e £ V\j D and Lemma 15.31 applies: 



Jo 



>aij <r^da*(&c — Sx) + ^ a 0s G 0s (£o)+ 

s=0 

i-i 

+ A (£q) + ^ai s ^ ls (? ) , (^ij - <tij-i)$> 

8=0 

= {d^(?o), ^){(d^(? ), W-^o-^ij-i,^-) $>)- 
- (d0£$O , ^)tr (^IJ-l, ^y) (4)} = 
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(d^(4), ^)(d^.(4) ; 6e)<rCd 1)j - 1 ,~d lj ) fa), 



a contradiction. 

Let us now turn to the degenerate case dri|^ a = & T 2\T-£ A- From equations (|4,14p 

one can recursively show that (d6*^(^o) , 8£)\t~ A = (d#ij(A)) > ^)|T|- A for any 51 S Tg Q A 
and for any j = 1, . . . , J\, so that A\j = A 2 j and B\j = B 2 j and the result can be proved 
repeating the proof of Lemma 16.11 

This proves the invertibility of , j = 1, . . . , J\. Thus the map 

id xirH: [0,T] x A M 

is one-to-one from a neighborhood of [0,T] x {A(0)} in [0, T] x A and we can apply the 
procedure described in Section [3] 

6.1 Proof of Theorem [23] 

Let 

id xtt-H : [0,T] x 0->V= [0,T] xW 

be one-to-one and let £ : [0, T] — > M be an admissible trajectory whose graph is in V. 
Applying the Hamiltonian methods explained in Section [3] we have: 

C(S,u)-C(lu)>?(S(T))-?(x f ). 

Thus, to complete the proof of Theorem l2.3l it suffices to show that T has a local minimum 
at Xf. In order to shorten the notation, let us denote Vt(^) : = (tt^t) -1 ^)- 

Theorem 6.3. F has a strict local minimum atxf. 

Proof. It suffices to prove that 

d F(x } ) = and D 2 T(x f ) > . (6.8) 



The first equality in H 6 . 8 [) is an immediate consequence of the definition of T and of PMP. 
Let us prove that also the inequality holds. 
Since d(a o it^t) = Ht ° ^T> we a l so have 



(6.10) 



&F = U T o V^T + d/3 (6.9) 
D 2 nx f )[5x f ] 2 = ((H T o i> T )* + D 2 /3) (x f )[5x f } 2 
= a ((T-Lt ° ipT)*5xf,d(-(3)*8xf) 

From Lemma 15.41 we have 
l Ji 



(xq) + bh v (x )) 

i=0 s=0 

1 Ji 

(? ) + &#„$,)) <0. (6.11) 



i=0 s=0 
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Applying %t* to both arguments and using the anti-simmetry property of a we get 

a {%t* da*5x, d(— (3)*((it'Ht)* da*5x)) > 
which is exactly (|6.10p with 5x := Tt*i[)T*£iXf. □ 



To conclude the proof of Theorem 12.31 we have to show that £ is a strict minimizer. 
Assume C(£,tt) = C(£,u). Since Xf is a strict minimizer for F, then £(T) = xt and 
equality must hold in f j 3 . 1 j) : 



(«.(vr 1 «W)). eoo> = H.(«.(^- i (f(«)))). 

By regularity assumption, u(s) = for any s at least in a left neighborhood of T, 
hence £(s) = £(s) and V ; s~ 1 ( , ?(' s )) = ^0 for an Y s m such neighborhood, u takes the value 
^\(§u T) un til T~is'>P7 1 (S,(s)) = ~H s (£o) = A(s) hits the hyper-surface K\ y j 1 = Ki^—i, 

which happens at time s = 0\ t j 1 . At such time, again by regularity assumption, u must 



switch to u\ 



, so that £(s) = £(s) also for s in a left neighborhood of ^i,^. 



Proceeding backward in time, with an induction argument we finally get (£(s), u(s)) = 
(£(s),tt(s)) for any s G [0, T]. 

In the abnormal case the cost is zero, thus the existence of a strict local minimiser 
implies that the trajectory is isolated among admissible ones. 

7 Appendix: Invertibility of piecewise C 1 maps 

This Section is devoted to piecewise linear maps and to piecewise C 1 maps. Our aim is 
to prove a sufficient condition, in terms of the "piecewise linearization", of piecewise C 1 
maps. 

Some linear algebra preliminaries are needed. 

Lemma 7.1. Let A and B be linear automorphisms of W 1 . Assume that for some 
v G (W 1 )* \ {0}, A and B coincide on the space tt(v) := {x G R n : (v , x) = 0}. Then, 
the map Cab defined by x h- )■ Ax if (v , x) > ; and by x i— >■ 5s i/ (t> , x) < 0, is a 
homeomorphism if and only if det(A) ■ det(-B) > 0. 

Proof. Let w±, . . . , u> n -i be a basis of the hyperplane ir(v). We complete it with v to 
obtain a basis of W 1 . The matrix of A~ 1 B in this basis is given by 



tn-l 



7i 



7n-l 



7n / 



where J n _i is the n — 1 unit matrix and n _i is the n — 1 null vector and the 7j's are 
defined by 



n-1 



i=l 
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Thus 7„ is positive if and only if det(A) det(B) is positive and 7„ is zero if and only 
either A or B is not invert ible. 

Observe that if ^ n is negative, then 

Cabv = Cab ( ^ -— w% + — v ] . 

\i=i 7n 7n / 

Thus, in this case Cab is not one-to-one. 

We now prove that Cab is injective if j n is positive. Assume this is not true. Since 
both A and B are invertible, there exist za, zb £ K n such that (v , za) > 0, (t> , zg) < 
and Aza = Bzb or, equivalently, A _1 Bzb = za- Let 

n— 1 n— 1 

= c^^i + caw, = c l B u;; + c B v. 

i=l »=1 

Clearly > 0, cb < 0. The equality A~~ 1 Bzb = za is equivalent to 

n— 1 Ti—l n—1 

^ c^Wi + c B ^ 7iWj + cs7„u = ^ c A Wi + c A v. 

i=l i=l i=l 

Consider the scalar product with v, we get c_B7 n ||u || 2 = caII^H , which is a contradiction. 

We finally prove that, if 7„ is positive, then Cab is surjective. Let z £ W 1 . There 
exist yA, Vb G such that Ay a = Bys = z. If either (v , ?/a) > or (v , ys) < 0, 
there is nothing to prove. Let us assume {v , yA) < and (v , ys) > 0. In this case 
A~ 1 Bys = yA an d proceeding as above we get a contradiction. □ 

Definition 7.1. Let G : W 1 — > W 1 be a continuous, piecewise linear map at 0, in the 
sense that G is continuous and there exists a decomposition Si,... ,Sk of W 1 in closed 
polyhedral cones (intersection of half spaces, hence convex) with nonempty interior and 
common vertex in the origin and such that dSi H dSj = Si fl Sj, i ^ j, and linear maps 
Li,...,L k with 

Cr(x) = L{X, x £ Si, 
with LiX = LjX for any x £ Si (~) Sj, and det Li ^ 0, Vi = 1, . . . , k. 

Example 7.1. As an example of continuous piecewise linear map consider G : M. 2 — > M. 2 
given by 



I 0\ L = ( 1 ~V2\ L f-V2 -V2 + 1 



01/ 2 \0 V 1 o 



Ll { v^+1 -U) Lb ~ (^V^ 1 



where the Lj's are applied in the corresponding cone Si illustrated in picture [8] 
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(a) The cones Si (b) The map G transforms the argu- 

ment of unit vectors. 

Figure 8: Polyhedral cones and the transformation of unit vectors under G 



Observe that any continuous piecewise linear map G is differentiable in W 1 \U^ =1 dSi. It 
is easily shown that G is proper, and therefore deg(G, M n ,p) is well-defined for any p G M. n 
(the construction in |12| . Chapter 5 is still valid if the assumption on the compactness 
of the manifolds is replaced with the assumption that G is proper. Compare also |6]). 
Moreover deg(G ,M. n , p) is constant with respect to p. So we shall denote it by deg(G). 

We shall also assume that det Lj > for any i = 1, . . . , k. 

Lemma 7.2. // G is as above, then deg(G) > 0. In particular, if there exists g / 
such that its preimage G^ 1 (q) is a singleton that belongs to at most two of the convex 
polyhedral cones Si, then deg(G) = 1. 

Proof. Let us assume in addition that q £ U^ =1 G(dSi) . Observe that the set uf =1 G(dSi) 
is nowhere dense hence A := G(Si) \ U^ =1 G[dSi) is non-empty. 

Take x G A and observe that if y G G _1 (x) then y ^ U^ =1 dSi. Thus 



deg(G) 



E 

yeG-Hx) 



sign detdG(y) = 



(7.1) 



Since G 1 (x) ^ 0, deg(G) > 0. The second part of the assertion follows taking x = q in 

(ED. 

Let us now remove the additional assumption. Let {p} = G 1 (q) be such that p G 
dSi n dSj for some i ^ j. Observe that by assumption p ^ does not belong to any cone 
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dS s for s ^ {i, j}. Thus one can find a neighborhood V of p, with V C int (SjU5'j\{0}). 
By the excision property of the topological degree deg(G) = deg(G, V,p). Let CiiLj be a 
map as in Lemma [7.11 Observe that, the assumption on the signs of the determinants of 
L{ and Lj imply that CiiLj is orientation preserving. Also notice that C^ijldV = G\gy. 
The multiplicativity, excision and boundary dependence properties of the degree yield 
1 = deg(C LiLj ) = deg(£ LiLj ,V,p) = deg(G, V,p). Thus, deg(G) = 1, as claimed. □ 

7.1 Piecewise differentiable functions 



Lemma 7.3. Let A and B be linear endomorphisms of W 1 . Assume that for some 
v G 1" \ {0}, A and B coincide on the space {x £ W 1 : (x,v) = 0}. Then 

det (tA + (1 - t)B) = tdet A + (1 - t)detB \/t G R. 

Proof. We can, without loss of generality, assume that \v\ = 1. We can choose vectors 
W2, • • • , w n G M n \ {0} such that v, W2, • • • , w n is an orthonormal basis of W 1 . In this 
basis, for t G [0, 1] we can represent the operator tA + (1 — in the following matrix 
form: 

/ tan + (1 - t)b n ai2 ■ ■ 
\ta n i + (1 - t)b n i a n2 ■ ■ 

Thus, 

det (tA + (1 - t)B) 



where An and Bn represent the (zl)-th cofactor of A and B respectively. Clearly, 
An = En for i = 1, . . . , n. Hence, we have 

n 

det (tA + (1 - t)B) = ^2(-l) i+1 ta t i det A a + 

i=l 

n 

+ ^(-l) m (l -t)bn detB a = tdet A + (1 - t) det B 
i=i 

as claimed in the lemma. □ 
Lemmas 17. II and 17.31 imply the following fact: 



ain\ ( tan + (1 - t)bu b u ... h n \ 



\ta n i + (1 - t)b n i b n2 ... b nn ) 



^(-l) i+1 (taa + (1 - t)ba) detAa 
i=i 

n 

^(-l) i+1 (taii + (1 - t)b iX ) det^i 



i=i 
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Lemma 7.4. Let A and B be linear automorphisms of W n . Assume that for some 
v G K n \ {0}, A and B coincide on the space {x G M n : (x,v) = 0}. Assume that 
the map Cab defined by x i— > Ax if {x, v) > 0, and by x i— )■ Bx if (x, v) < 0, is a 
homeomorphism. Then, det(A) • det it A + (1 — t)B) > for any t G [0, 1]. 

Let o"i, . . . , a r be a family of C -regular pairwise transversal hyper-surfaces in R n with 
a^o G n[ =1 (Tj and let J7 C 1" be an open and bounded neighborhood of Xo- Clearly, if U 
is sufficiently small, £/\U[ =1 <7j is partitioned into a finite number of open sets Ui, . . . , 

Let f : U W 1 be a continuous map such that there exist fi, ■ ■ ■ , fk G C 1 (C7) with 
the property that 

/(x) = /i(s), xGZ7 i; (7.2) 

with = for any x G UiPiUj. Notice that such a function is PC l {U) (see 

e.g. |1U] for a definition), and Lipschitz continuous in U. 

Let S\,...,Sk be the tangent cones (in the sense of Boulingand) at xq to the sets 
Ui, . . . ,Uk, (by the transversality assumption on the hyper-surfaces U{ each Si is a convex 
polyhedral cone with non empty interior) and assume dfi(xo)x = dfj(xo)x for any x G 
Si Pi Sj . Define 

F(x) = dfi(x )x xGSi. (7.3) 

so that F is a continuous piecewise linear map (compare [10J). 

One can see that / is Bouligand differentiable and that its B-derivative is the map F 
(compare |10[ 13J ) . Let ?/o := f( x o)- There exists a continuous function e, with e(0) = 0, 
such that f(x) = yo + F(x — Xq) + \x — xo\e{x — xq). 

Lemma 7.5. Let f and F be as in (|7.2p - (|7.3p . and assume that detd/j(a;o) > for all 
i = 1, . . . , k. Then there exists p > such that deg (/, B(x$, p), yo) = deg (-F, B(0, p), 0) . 
In particular, deg (f,B(x ,p),y ) = deg(F). 

Proof. Consider the homotopy H(x, A) = F(x — xq) + A \x — xq\ e[x — xq), A G [0, 1] and 
observe that 

m := inf{|i ? (f)| : |u| = 1} = min \\dfi\\ > 0. 

i=l,...,k 

Thus, 

\H(x, A) | > (m— \e(x — xq)\ ) \x — xq\ . 

This shows that in a conveniently small ball centered at xq, homotopy H is admissible. 
The assertion follows from the homotopy invariance property of the degree. □ 

Theorem 7.6. Let f and F be as in fjT.2 j) - fj7.3|) and assume det dfi(xo) > 0. Assume also 
that there exists p G 1" whose pre-image belongs to at most two of the convex polyhedral 
cones Si and such that F _1 (p) is a singleton. Then f is a Lipschitzian homeomorphism 
in a sufficiently small neighborhood of xq. 

Proof. From Lemmas 17. 2W7.5| it follows that deg(/, B{xq, p),Uo) = 1 for sufficiently small 
p > 0. By Theorem 4 in [13] . we immediately obtain the assertion. □ 
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